
# 



Memory 



14A 



18C — 7 



16A 



Memory 



14B 



16B 







MC 








-Processing 
Node 
12A 






IF N 





24E 



18G 



18A 



18D 
24A 



18B 



24F 



4 


IF ' 






Processing 
Node 
12C 


-i 






MC 







T 



18H 

I — 181 



Memory 



16C 

— 14C 



24B 







MC 


/ 




\ 

>— < 


-Processing- 
Node 








12B 








IF v 





24C 



18J 
24G 



24H 



18F 



18E 



24D 







IF 


/ 




\ 








/ 




Processing 








Node 










12D 








MC 


\ 





18K 
— 18L 



I/O 
Bridge 



20 



Memory 



I/O^ 
16D Bus^ 

— 14D 



22 



10 



Fig. 1 



J 

) 







CLK 




PROCESSING 
NODE 


PROCESSING 

1 1 \ 111 %M 

NODE 


2466-^ 


CTL 


24BC^ 


CAD[n:0] 


12A 


CLK 


^-24AA j 


12 B 




CTL 


^24AB j 






_CAD[n:0] 


^24AC. 











FIG. 2 



Bit 
Time 


7 6 


5 4 


3 2 


1 0 


0 


RSV 


CMD[5:0] 


1 


RespData 

[1:0] 


Response 

[1:0] 


PostCmd 
Data[l:0] 


PostCmd 

[1:0] 


2 


RSV 


Probe 

[1:0] 


NonPost 
Data[l:0] 


NonPost 
Cmd[l:0] 


~ 3 " 


RSV " 



FIG. 18 



Bit 
Time 

0 



30 



CMD[5:0] 



FIG. 3 



o 



Bit 
Time 



0 



0 



Src Unit 
[1:0] 



CMD[5:0] 



r 



! DestNode[2:0] jj Un *f 



SrcNode[2:0] 



L. 



SrcTag[4:0] 



Addr[7:2] 



Addr[15:8] 



5- 



-Addr[23:16] ._. 



Addr[31:24] 



Addr[39:32] 



FIG. 4 



Bit 
Time 


7 


6 


5 


4 3 


2 1 0 


0 


[" Src Unit i 
L [1=0] ! 


CMD[5:0] 


1 


DestNode[2:0] 


Dest 
Unit[l:0] 


! SrcNode[2:0] ! 

i_ 1 


-2-- 




|~ SrcTag[4.:0] 


3 


|~Sh ! 

i 1 





34-^ FIG. 5 



Bit 
Time 


7 6 5 4 3 2 1 0 


0 


Data[7:0] 


1 


Data[15:8] 


2 


Data[23:16] 


3 


Data[31:24] 


4 


Data[39:32] 


-5- 


Data[47:40] 


6 


Data[55:48] 


7 


Data[63:56] 



FIG. 6 



CMD Code 


VChan 


Command 

vvl 1 1 1 1 IU 1 IVi 


Packet TvDe 


UUUUUU 




l\l f\ K\ 

IN Op 


infn 

INTO 


0U0U01 


NPC 


VICblK 


Kequesi/ AQaress / uaia 


000U10 




Keservea 




nnnni i 
0UUU11 


NPC 


vaiiaatebiK 


Kequesi/ Aaaress 


— UUU1UU — 


m no 

NPC - 


- kqdIk 


Keq u esi /j\qq ress 


nnnini 
UUU1U1 


NPC 


DrIDli/C 

KudIKo 


Kequesi/ Aaaress 


UUU11U 


NPC 


KaDlKIVIOQ 


Kecjuesi/ Aaaress 


r\nr\i 1 1 

000111 


NPC 


Change loDirty 


Request/ Address 


Wf ll www 

xuixxx 


mdo no 

NPC or PC 


wrioizeaj 


Kequesi/ Aaaress / uaia 


Olxxxx 


M no 

NPC 


Keaa(bized) 


[Jmm ■ i mm* / A mJ mJ iiMnn 

Kequesi/ Aaaress 


100XXX 




Reserved 




11U0UU 


R 


Kd Kesponse 


Kesponse / uaia 


11U0U1 


R 


rrobeKesp 


Response 


I1UU1U 


R 


igiotart 


Response 


1 1 nni i 
11UU11 


n 

R 


igtuone 


Kesponse 


union 


p 


Of UuUllC 


IXGOpUl IOC 


110101 


R 


MemCancel 


Response 


HOllx 




Reserved 




lllOOx 


P 


Probe 


Request/ Address 


UlOlx 


P 


Broadcast 


Request/ Address 


llllOx 




Reserved 




111110 




Reserved 




nun 




Sync 


Info 



FIG. 7 




Fig. 8 



Virtual Channels 



Virtual Channel 


Applicable Links 


- Posted Commands 


_Coherent_and Noncoherent 


Non-Posted Commands 


Coherent and Noncoherent 


Responses 


Coherent and Noncoherent 


Probes 


Coherent Only 



Fig. 9 



MC 16A 



a 
m 

£2 

a 
m 
o 
ill 

V. 

o 

CO 

H° 
HI 
O 
£3 



oo 
O 



1 



Packet Processing Logic 58; 





IF 18B 



12A 



Fig. 10 



OX) 



DO 





o 






o 




w 

c 






o 


<L> 




a. 




to 


c 




Re 


Coui 





2 CQ 

S ° 


64F 




A 

1 


PB 


64D 






i 


o 

e- cq 
2 


64B 





^ CQ 


O 




« Q 


























Bu 


ool 


SI 




Pu 








Q 







< CQ U 

vo vo 

r*- 



S of 




oo_ * | 



err 





CM 




< 


< 


< 


Oh 


Oh 




Q 


Q 


Q 






m 


< 


< 


< 


Oh 




Oh 


u 


U 


o 



< pq y 
^ ^ 5" 



CQ 


< 




CJ 








AO 





i O Cu 





M 
ol 






PB 


62D 






i 


u 

c- CQ 
Z 


62B 






CJ CQ 

Q 


62E 


L 

i 


▲ 




62C 


i 

i 

! 


▲ 




PCB 


62A 


i 
! 

H 

! 
t 



03 

Q 



PQ 
oo 



s 

p 



r, 



o 

vo 



2 CQ 


O 

VO 


* 


t 


CQ 

Oh 


Q 
o 

VO 




▲ 


1 




CQ 
o 





CQ 

Q 



CJ PQ 




o 

<4-< 



CQ 

_Q._ 

Oh 



o 

-4— » 


ft 






o 




CJ 







82 y 


84 y 


88 




-86 


Source 
Tag 


Source 
Node 


Source 
Unit 


Data 



80 




Fig. 12 



92 



94 



95 



96 



98 



Source 
Tag 


Source 
Node 


Source 
Unit 


Response Count 


Receive 
State 



90 



Fig. 13 



r 



102 




FIG. 14 



STORE BIT TIME IN 
DATA BUFFER 

INDICATED BY DATA 
PACKET ACTIVE 
REGISTER 



tfi 



106 



DECODE COMMAND FIELD TO 
DETERMINE VIRTUAL CHANNEL 
AND THEREFORE COMMAND PACKET 
BUFFER. SET COMMAND PACKET 
ACTIVE REGISTER 



STORE BIT TIME IN 
COMMAND PACKET 
BUFFER INDICATED BY 
COMMAND PACKET 
ACTIVE REGISTER 




n 

112 



SET DATA PACKET ACTIVE 
REGISTER TO INDICATE 
DATA BUFFER CORRESPONDING 
TO VIRTUAL CHANNEL 



END-RECEIVE *\ 
PACKET J 



c 



START-PROCESS 
REQUEST PACKET 



FIG. 15 



TARGET = 



YES 



128 



v. this node ^ 
Jno 


130 






_ FORWARD REQUEST (AND DATA) 




PROVIDE REQUEST 


PACKETS ACCORDING TO PACKET 




(AND DATA) PACKETS 


ROUTING IF BUFFER AVAILABLE 




TO MEMORY CONTROLLER 



c 



END-PROCESS 
REQUEST PACKET 



""J 



FIG. 27 



262 



ALLOCATE DATA 
BUFFER FROM DATA 
BUFFER POOL 



YES 




TRANSMIT 
REQUEST 
PACKET 



-264 



( END - NITIATE "\ 
V TRANSACTION J 



''Start - Process > 
^Response Packet/ 




Yes- 



Forward 
Response (and 
Data) Packets 
According to 
Packet Routing if 
Buffer Available 



Decrement 
- -Corresponding. _ 
Response Count 
and Update State, 
if applicable 



T 



150 



Move Data Packet 
to Corresponding 
Allocated Data 
Buffer, if 
applicable 



-Yes 



Complete 
Corresponding 
Command, 
Deallocate Counter 
and Data Buffer 




T T T. 



End -Process > 
Response Packe^ 



Allocate Data 
Buffe r fr om Data 
Buffer Pool 




Allocate Response Counter, 
Set Initial Count to Number 
ofNodes 



Allocate Response 
Counter, Set Initial 
Count to one 



170 



Transmit Packet 



End - Initiate 
Packet 



Fig. 17 



24J 



to Processing 
Node 12D 



241 



Host Bridge 
202 



□ 

m 
5 

m 
a 
m 

a 
m 

H 

a 

o 



24L 



24K 



I/O Node 
204A 



24N 



24M 



I/O Node 
204B 



24P 




240 



200 



Fig. 19 



CMD Code 


VChan 


Command 


Packet Type 


uuuuuu 




Nnn 


Infn 


nnnnni 




Rp<;pr\/pH 
rvcoci vcu 




nnonm 

UUUU1U 


NPP 


1 IUOI 1 


Rpnnp^t 


vUV/Ull 




Rpcpn/prl 




UUU1XX 




Pocorv/oH 
rvcaci VcU 




vA1 vvv 
XUIXXX 


INrL» Or rL/ 


vvi voiz.cuy 


Rpnnoct / AHHtpcc / Data 


f| 1 WW 






Rpni iPQt / AHHrPCQ 
rxcijUcoL/ nuuicoo 


1UUXXX 




Rcccrv/orl 




1J.UUUU 


p 


RHRocnnnco 
r\ur\Co|JUi loc 


Rocnnnco / Hata 
rxcofJUiioc/ uaia 


11 nnni 




Rpcprvprl 




110010 




Reserved 




110011 


R 


TgtDone 


Response 


11010X 




Reserved 




UOllx 




Reserved 




UlOOx 




Reserved 




lllOlx 


PC or NPC 


Broadcast 


Request/Address 


111100 


PC 


Fence 


Request 


111101 




Reserved 




111110 




Reserved 




nun 




Sync 


Info 



210/2. 

fFg". 20 



Time 



5 



0 



0 



SeqlD[3:2] 



CMD[5:0] 



Pass 
PW 



SeqIDtLO] 



UnitlD[4:0] 



SrcTag[4;0] 



Addr[7:2] 



Addr[15:8] 



Addr[23:16] 



Addr[31:24] 



Addr[39:32] 



212 



FIG. 21 



Bit 
Time 


7 


6 


5 


4 3 2 1 0 


0 




CMD[5:0] 


1 


Pass 
PW 




UnitlD[4:0] 


2 




SrcTag[4:0] 


3 





214 



FIG. 22 



# 




r 



102 




FIG. 24 



STORE BIT TIME IN 
DATA BUFFER 

INDICATED BY DATA 
PACKET ACTIVE 
REGISTER 



106 



DECODE COMMAND FIELD TO 
DETERMINE VIRTUAL CHANNEL 
AND THEREFORE COMMAND PACKET 
BUFFER. SET COMMAND PACKET 
ACTIVE REGISTER 



STORE BIT TIME IN 
COMMAND PACKET 
BUFFER INDICATED BY 
COMMAND PACKET 
ACTIVE REGISTER 




r 



112- 



- -SET DATA-PACKET. ACTIVE 

REGISTER TO INDICATE 
DATA BUFFER CORRESPONDING 
TO VIRTUAL CHANNEL 



J 



END-RECEIVE 




YES 



240 



ACCEPT PACKET 
AND PROCESS 



FORWARD 


REQUEST 


(AND 


DATA) 


PACKETS IN SAME DIRECTION 


IF BUFFER 


AVAILABLE 



c 




END - PROCESS 
REQUEST PACKET 



* 



FIG. 26 




COMPLETE 
CORRESPONDING 
REQUEST, DEALLOCATE 
DATA BUFFER 

] 



END - PROCESS 
REQUEST PACKET 



FIG. 28 



n Ami aw « Tvnr 

KCQUeSC 1 TYPE 


nAfliiAM a Tvnr 

RCQUeSI 2 TtPE 


WAIT REQUIREMENTS 


MLMOKY WKIIt 


MLMOKY WKIIt 


1 Dfldo Ml ICT U/AIT CAD Tfltcforfi 

J. KcQ2 MUol WAII run mm\\. 

2.srcDone2 must wait for TgtDonei . 

1 itiMh ON THF NrtN-TnHFRFNT i INK (IF RFOIIIRFD) 

J, ItlUUIIt^ vll IML null uul ILIxLll 1 UM(\ ^11 HlVxUIRLu/ 

MUST WAIT FOR TgtDOnei . 


MEMORY WRITE 


MEMORY READ 


1. Req2 MUST WAIT FOR 

2. Tgt Done2 ON THE NON-COHERENT LINK MUST WAIT FOR TgtDOFiei . 


MEMORY READ 


MEMORY REQUEST 


Req2 MUST WAIT for Tgtstarti. 


-MFkJIARY-WRITF 


l/U KWULol UK 

INTERRUPT 


-RWh-MIKT-WfilT FAR -TflKM-i - - 
nv^l IVIUOI iiflll i\ln IglolOH]. 


MEMORY READ 


I/O REQUEST 


Req2 MUST WAIT FOR TgtStaitl. 


MEMORY WRITE 


FLUSH 


TgtD0ne2 ON THE NON-COHERENT LINK MUST WAIT FOR TgtDOnei . (FLUSH 
DOES NOT CAUSE ANY REQUESTS TO BE ISSUED TO THE COHERENT FABRIC.) 


MEMORY READ 


FLUSH OR 
INTERRUPT 


NO WAIT REQUIREMENTS 


MEMORY WRITE 


RESPONSE 

1 1 fa* V 1 W 1 1VL 


Response 2 must watt for TgtDonei . 


MEMORY READ 


RESPONSE 

1 1 fas V 1 VI Ivk 


Response? must wait for Tgtstaiti. 


I/O REQUEST 


MEMORY REQUEST 


Req2 MUST WAIT FOR Tgtstaiti. 


I/O REQUEST 


I/O REQUEST OR 
INTERRUPT 


ReQ2 MUST WAIT for Tgtstaiti. 


I/O REQUEST 


FLUSH 


TgtD0ne2 ON THE NON-COHERENT LINK MUST WAIT FOR TgtStaitl- (FLUSH 
DOES NOT CAUSE ANY REQUESTS TO BE ISSUED TO THE COHERENT FABRIC.) 


I/O REQUEST 


RESPONSE 


Response? must wait for Tgtstaiti. 


FLUSH 


ANYTHING 


NO WAIT REQUIREMENTS 


RESPONSE 

1 1 Lb VI VI lVb 


ANYTHING 


NO WAIT REQUIREMENTS 


FIXED /NON 
VECTORED INTERRUPT 


RESPONSE 


Response2 must wait for all broadcast message responses to 

BE RECEIVED. 


FIXED /NON 
VECTORED INTERRUPT 


ANYTHING BUT 

r II 1 1 1 1 111 Iv arWI 

RESPONSE 


NO WAIT REQUIREMENTS 


LPA INTERRUPT 

LI f 1 1 1 1 1 LI 11 IVI I 


ANYTHING 

f II 1 1 1 1 III 1U 


NO WAIT REQUIREMENTS 

Mw IIIIII IlL^Utl ILI1ILI 1 1 w 


SVSMrf 


ANYTHING 


NO WAIT REQUIREMENTS 

llw IIIIII 1 lLV(vll \LlllLi 1 1 V 


FENCE 


POSTED REQUEST 


Req2 MUST WAIT FOR FENCE TO BE RETIRED. 


FENCE 


ANYTHING 
NONPOSTED 


NO WAtf REQUIREMENTS 


POSTED 

MEMORY WRITE 


FENCE 


Req2 MAY BE RETIRED WHEN TgtDOnei . 


POSTED I/O WRITE 


FENCE 


Req2 MAY BE RETIRED WHEN Tgt Start l. 


ANYTHING NONPOSTED 


FENCE 


NO WAff REQUIREMENTS 



272 
274 



270 



